System and method for timely and uniform distribution for real-time packet transmission

ABSTRACT

A system and method is provided for timely and uniform real-time data packet transmission by a computing device. The system can include a shared packet memory buffer for storing data packets generated by a user application and a shared schedule memory buffer for storing packet identifiers and corresponding time slots for the data packets. Moreover, a kernel module is provided that operates in the kernel mode of the operating system directly above the network interface controller and can continuously poll the shared scheduled memory to access packet identifiers at corresponding time slots. Based on the packet identifiers in each time slot, the kernel module can pull the data packet having the packet identifier directly from the ring buffer and send each packet to the network interface controller for transmission as part of a media stream over a network to a media consuming device.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of U.S. patentapplication Ser. No. 15/938,602, filed Mar. 28, 2018, which claimspriority to U.S. Patent Provisional Application No. 62/482,601, filedApr. 6, 2017, the entire contents of each of which are herebyincorporated in their entirety.

TECHNICAL FIELD

The disclosure generally relates to data transmission, and, moreparticularly, to a system and method for timely and uniform distributionreal-time data packet transmission over a network.

BACKGROUND

As media production migrates to packet-based data infrastructures,personal computer (PC) based software must be able to transmit highbitrate streams of data over a network to transport uncompressed videoand audio data. Moreover, because many of the devices consuming thesedata streams perform minimal data buffering, senders in the networkshould try to space the transmitted data packets as evenly as possibleto achieve a constant flow of packets instead of a burst for each frameor field in order to minimize data buffering requirements by the mediaconsuming devices.

Moreover, in recent years, the Society of Motion Picture and TelevisionEngineers® (SMPTE®) has standardized the use of IEEE 1588 precision timeprotocol (“PTP”) to provide time-aligned signal generation and permitthe interoperable use of IP-based media equipment with conventionalgenlocked serial digital interface (“SDI”) equipment. These standards,and, in particular, SMPTE ST 2059-1, require that frames should to besent at exactly the same time by all devices. As a result, it is evenmore critical that transmitting devices avoid transmission delays andpacket bursts.

Modern non-realtime PC operating system (such as Windows® and mostversions of Linux®, for example) provide little control on when certainoperations will be executed, including, for example, when network datapackets will be sent. As a result, it is nearly impossible for devicesrunning on these operating systems to evenly space the transmission ofsuch data packets. In particular, each individual data packet that issent by a user mode application running on one of these existingoperating systems will have to transition between the user mode andkernel mode, which inevitably leads to the delay of transmitting datapackets.

FIG. 1 illustrates a conventional operating system network model. Asshown, the operating system transitions between two distinct modes: usermode 10 and kernel mode 20. In user mode 10, the executing applications(e.g., applications 12A, 12B and 12C) have limited access to thecomputer hardware or reference memory, but cannot access the NIChardware or NIC memory and must delegate this access to the systemapplication programming interfaces (“APIs”). In contrast, in kernel mode20, the executing code has complete and unrestricted access to theunderlying hardware (including the NIC) and can execute any CPUinstruction and reference any memory address. Accordingly, when a usermode application (e.g., application 12A) needs to transmit a datapacket, the data packet must transition through multiple layers (e.g.,network layers 22A, 22B . . . 22N) of the network stack of the kernelmode 20, which might include a firewall, anti-virus layers and the like,before reaching the driver 24 of the network interface controller(“NIC”), which ultimately transmits the data packet. As such, each ofthese steps to transmit every data packet requires time that causeproblems when try to send for high bit rate/packet rate since everyoperation must be performed on the same thread to guarantee the packetorder is kept during transmission.

Moreover, the ever improving video standards and resolution capabilitiesof media consuming devices only further increases the requirements forbit rate and packet rate. For example, current video standards andresolution can reach up to 1 million packets per second for a singlestream at 12 Gbps (e.g., for a SMPTE ST 2022-6 ultra-high definition(“UHD”) stream), meaning that a packet has to be sent every aboutmicrosecond (p).

Accordingly, a system and method is desired for timely and uniformdistribution real-time data packet transmission of a network.

SUMMARY

A system and method is provided for timely and uniform real-time datapacket transmission by a computing device. The system can include a ringbuffer for storing data packets generated by a user application and ashared schedule memory buffer for storing packet identifiers andcorresponding time slots for the data packets. Moreover, a kernel moduleis provided that operates in the kernel mode of the operating systemdirectly above the network interface controller and can continuouslypoll the shared scheduled memory to access packet identifiers atcorresponding time slots. Based on the packet identifiers, the kernelmodule can pull the data packets directly from the ring buffer and sendthem to the network interface controller for transmission as part of amedia stream over a network to a media consuming device.

In one particular aspect, the system includes network interfacecontroller configured to transmit data packets over a network; a firstshared memory buffer; and a second shared memory that includes an arrayfor a plurality of time slots for the data packet transmission.Moreover, the kernel module is operating in a kernel mode of anoperating system of the computing device and is configured to generate apacket group. Furthermore, one or more software application areoperating in a user mode of the operating system of the computingdevice, and each can be configured to generate at least one data packet;access a free packet of the packet group; fill the free packet with theat least one data packet; and schedule a transmission time of the atleast one data packet by storing a packet identifier associated with theat least one data packet in one of the plurality of time slots in thearray of the second shared memory buffer. In addition, the kernel moduleis further configured to poll the second shared memory to access thepacket identifier at each corresponding time slot and obtain, ifavailable, a data packet having the packet identifier from the ringbuffer to be transmitted by the network interface controller.

In another exemplary aspect, a system is provided for timely and uniformreal-time data packet transmission by a computing device according toanother embodiment. In this aspect, the system includes a networkinterface controller configured to transmit data packets over a network;a first shared memory buffer configured to store a plurality of datapackets to be transmitted over the network; a second shared memorybuffer that includes an array configured to store a plurality of timeslots for the data packet transmission; and a kernel module operating ina kernel mode of an operating system of the computing device andconfigured to generate at least one packet group for the first sharedmemory buffer. Moreover, the system includes at least one softwareapplication operating in a user mode of the operating system of thecomputing device, the at least one software application configured togenerate a plurality of data packets; access a free packet of the atleast one packet group in the first shared memory buffer; fill the freepacket with a payload of one of the plurality of data packets; andschedule a transmission time of the one data packet by storing a packetidentifier associated with the one data packet in one of the pluralityof time slots in the array of the second shared memory buffer. Accordingto the exemplary system, the kernel module is further configured to pollthe second shared memory buffer to access the packet identifier andcorresponding time slot and access the one data packet of the pluralityof data packets from the first shared memory buffer. Moreover, thekernel module is coupled to a driver of the network interface controllerand configured to control the driver to transmit the accessed one datapacket via the network interface controller over the network based onthe corresponding time slot in the second shared memory buffer.

According to a refinement of the exemplary aspect, the kernel module isfurther configured to bypass a network stack in the kernel mode of theoperating system to directly access the plurality of data packets fromthe first shared memory buffer for the timely and uniform real-time datapacket transmission of the accessed one data packet without the accessedone data packet transitioning through the network stack.

According to another refinement of the exemplary aspect, the kernelmodule is further to execute a thread for sending the plurality of datapackets stored in the first shared memory buffer by polling the secondshared memory buffer to access the stored plurality of time slots andcorresponding packet identifier for the plurality of data packets.

According to another refinement of the exemplary aspect, the systemfurther includes a plurality of software applications operating in theuser mode of the operating system with each of the plurality of softwareapplications coupled to a separate first shared memory buffer thatstores a plurality of data packets for the respective softwareapplication to be transmitted over the network. In this aspect, thekernel module is further to execute a pair of threads for sending theplurality of data packets for each of the respective softwareapplications, wherein each of the pair of threads alternates between asending state for sending at least one data packet and a sleeping state.Moreover, each thread can be configured to transition from the sendingstate to the sleeping state upon determining that the other thread hastransitioned from the sleeping state to the sending state, such that thekernel module is configured to circumvent at least one operational limitrequired by the operating system of the computing device to preventcontinuous thread execution by a processor of the computing device.

According to another refinement of the exemplary aspect, the systemfurther includes a plurality of second shared memory buffers that areeach coupled to one of the plurality of software applications,respectively, and that each store a plurality of time slots for datapacket transmission of each of the plurality of data packets for therespective software application to be transmitted over the network.

Moreover, in on exemplary aspect, the at least one software applicationis further configured to generate the packet identifier for each of theplurality of data packets based on a packet group number of the at leastone packet group created by the kernel module and a packet index numberof the respective data packet.

According to another refinement of the exemplary aspect, the kernelmodule is further configured to send a packet list to the driver of thenetwork interface controller that includes two or more data packets ofthe plurality of data packets when the kernel module determines that atleast one data packet of the two more data packets included in thepacket list is late on schedule according to the corresponding time slotin the second shared memory buffer.

According to a further refinement of the exemplary aspect, the kernelmodule is further configured to add the accessed one data packet to thefirst shared memory buffer, such that the at least one softwareapplication knows that the accessed one data packet was sent by thenetwork interface controller and that one or more additional datapackets of the plurality of data packets can be stored in place of theone data packet.

In another exemplary aspect, a system is provided for timely and uniformreal-time data packet transmission by a computing device, in which thesystem includes a first shared memory buffer configured to store aplurality of data packets generated by at least one software applicationoperating in a user mode of an operating system of the computing device;and a second shared memory buffer that includes an array configured tostore a plurality of time slots for the data packet transmission. Inthis aspect, the system further includes a kernel module operating in akernel mode of the operating system of the computing device, the kernelmodel including a packet group generator configured to generate at leastone packet group for the first shared memory buffer, a data packettransmission scheduler configured to poll the second shared memorybuffer to access a plurality of packet identifiers associated with theplurality of data packets generated by the at least one softwareapplication, the plurality of packet identifiers being associated withthe plurality of time slots for the data packet transmission,respectively, a data packet accessor configured to access each of theplurality of data packets from the first shared memory buffer based onthe respective packet identifier and corresponding time slot, and a datapacket transmission controller coupled to a driver of a networkinterface controller and configured to control the driver to transmiteach of the plurality of data packets via the network interfacecontroller over the network based on the corresponding time slot.

In another exemplary aspect, a system is provided for timely real-timedata packet transmission by a computing device, where the systemincludes a first shared memory buffer configured to store a plurality ofdata packets generated by at least one software application operating ina user mode of an operating system of the computing device; and a datapacket transmission controller operating in a kernel mode of theoperating system of the computing device and configured to directlyaccess the plurality of data packets from the first shared memory bufferfor the timely real-time data packet transmission of the plurality ofdata packets by bypassing a transition through a network stack in thekernel mode of the operating system before network transmission.

The above simplified summary of example aspects serves to provide abasic understanding of the present disclosure. This summary is not anextensive overview of all contemplated aspects, and is intended toneither identify key or critical elements of all aspects nor delineatethe scope of any or all aspects of the present disclosure. Its solepurpose is to present one or more aspects in a simplified form as aprelude to the more detailed description of the disclosure that follows.To the accomplishment of the foregoing, the one or more aspects of thepresent disclosure include the features described and exemplary pointedout in the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, which are incorporated into and constitute apart of this specification, illustrate one or more example aspects ofthe present disclosure and, together with the detailed description,serve to explain their principles and implementations.

FIG. 1 illustrates a conventional operating system network model.

FIG. 2 illustrates a block diagram of a system for timely and uniformdistribution real-time data packet transmission according to anexemplary aspect.

FIG. 3A illustrates a block diagram of a system for timely and uniformdistribution real-time data packet transmission according to anotherexemplary aspect.

FIG. 3B illustrates a block diagram of a system for timely and uniformdistribution real-time data packet transmission according to yet anotherexemplary aspect.

FIG. 4 illustrates a timing of the kernel module for executing multiplethreads for timely and uniform distribution real-time data packettransmission according to yet another exemplary aspect.

FIG. 5 illustrates a flowchart for a method for timely and uniformdistribution real-time data packet transmission according to anexemplary aspect.

FIG. 6 illustrates a flowchart for a method for execution of the sendingthread of the kernel module according to an exemplary aspect.

FIGS. 7A and 7B illustrate a flowchart for a method for scheduling datapackets for timely and uniform transmission according to an exemplaryaspect.

FIG. 8 illustrates a flowchart for a method for synchronizing aplurality of threads to perform shared timely and uniform distributionreal-time data packet transmission according to an exemplary aspect.

FIG. 9 illustrates a high-level block diagram of a system for timely anduniform distribution real-time data packet transmission according to anexemplary aspect.

DETAILED DESCRIPTION

Various aspects of the disclosed system and method are now describedwith reference to the drawings, wherein like reference numerals are usedto refer to like elements throughout. In the following description, forpurposes of explanation, numerous specific details are set forth inorder to promote a thorough understanding of one or more aspects of thedisclosure. It may be evident in some or all instances, however, thatany aspects described below can be practiced without adopting thespecific design details described below. In other instances, well-knownstructures and devices are shown in block diagram form in order tofacilitate description of one or more aspects. The following presents asimplified summary of one or more aspects of the invention in order toprovide a basic understanding thereof.

FIG. 2 illustrates a block diagram of a system for timely and uniformdistribution real-time data packet transmission according to anexemplary aspect. In general, an operating system (“OS”) network modelwith a kernel module is provided for managing the data packettransmission. In particular, it is contemplated that the exemplarysystem can be implemented on any type of computing device 50 (e.g., apersonal computer, laptop, server, etc.) that includes one or aplurality of software applications 120A, 120B and 120C (e.g., user modeapplications), that include functionality for generating data packets(e.g., forming media streams) to be transmitted over a network, such asnetwork 400, and ultimately to media consuming devices. It is noted thatthe number of applications is not particularly limited and that thedisclosed system can work with a single application.

In general, the term “data packet”, also referred to as a networkpacket, is well known to those skilled in the art and is a formattedunit of data that can be transmitted over a packet-switched network.Each data packet includes control information found in the packetheaders and trailers that identifies, for example, source anddestination network addresses, error detection codes, sequencinginformation, and the like. Moreover, each data packet also includes theuser data or payload, which in the case of media streams includes theaudio and video data, for example.

Typically, the processing to assemble packets, including the specifyingof certain control information, is performed by the network stack of thecomputing device. However, according to the exemplary aspect, thispacket processing is now performed by the respective user modeapplication (e.g., application 120B). For example, if user modeapplication 120B is designed to send UDP (“user data protocol”)/IP(“Internet protocol”) packets over Ethernet, application 120B will beconfigured to handcraft the packet starting by adding the Ethernetheaders followed by IP and UDP headers and then finally putting theactual payload in the data packet that it wants to send. These datapackets 314 are shown as being generated by application 120B and sent toshared memory 310 (i.e., a first shared memory buffer), which will bedescribed in more detail below. By formatting the data packets 314 byapplication 120B (or any user mode application), the data packettransmission system implemented on computing device 50 enables preciseand quick crafting of the packet to send as the code, which can betailored to the functional requirements of the user mode application120B.

As further shown, the computing device 50 has two modes: user mode 100and kernel mode 200. The distinction between these two modes isunderstood to those skilled in the art and described above. Each ofapplications 120A, 120B and 120C is a user mode application. Moreover,kernel mode 200 includes the network stack, shown to include networklayer 220A to 220N and can be any number of layers. It is noted thateach of applications 120A, 120B and 120C is shown to be communicativelycoupled (optionally) to the first network layer N in the network stack,and, therefore, each application can use all of these standard toolsprovided by the operating system of the computing device 50 to accessthe same network interface controller (i.e., the NIC software driver 240is shown). Advantageously, this configuration provides for performingoccasional network access, such as resolving Internet Protocol version 4(IPv4) addresses to Ethernet addresses using Address Resolution Protocol(“ARP”) that is normally built into the OS and can be reused for maximumreliability and interoperability.

In any event, according to the exemplary aspect, a kernel module 250 isan application in the kernel mode 200 that facilitates the timely anduniform transmission of data packets generated by one or more of theuser mode applications (shown as application 120B) according to theexemplary aspect. As will be described in detail below, the kernelmodule 250, which can also be considered a data packet transmissioncontroller, is configured to execute a number of functions forperforming the data packet transmission protocols described herein. Inone aspect, the kernel module 250 can include multiplecomponents/modules configured to execute the exemplary protocols. Forexample, a packet group generator can be included that generates packetgroups to be stored in the first shared memory buffer and a data packettransmission scheduler can be provided to poll a second shared memorybuffer to access a plurality of packet identifiers associated with theplurality of data packets generated by user mode one softwareapplication, with the plurality of packet identifiers being associatedwith the plurality of time slots for the data packet transmission,respectively. Moreover, the kernel module 250 can include a data packetaccessor that can directly access each of the plurality of data packetsfrom the first shared memory buffer based on the respective packetidentifier and corresponding time slot, and a data packet transmissioncontroller coupled to a driver of a network interface controller thatcan transmit control signals to the driver to control transmission ofeach of the plurality of data packets via the network interfacecontroller over the network based on the corresponding time slot. Theexemplary algorithms and protocols will be described in detail belowgenerally with respect to the kernel module 250.

Moreover, it is noted that as used herein, the term “module” generallyrefers to a software service or application executed by a processor of acomputer, such as computing device 50, that can include an arrangementof components implemented using hardware, such as by an applicationspecific integrated circuit (“ASIC”) or field-programmable gate array(“FPGA”), for example. Moreover, a “module” may be a combination ofhardware and software, such as by a microprocessor system and a set ofinstructions to implement the module's functionality, which (while beingexecuted) transform the microprocessor system into a special-purposedevice. A module can also be implemented as a combination of the two,with certain functions facilitated by hardware alone, and otherfunctions facilitated by a combination of hardware and software. Ingeneral, each module can be realized in a variety of suitableconfigurations, and should not be limited to any example implementationexemplified herein. It is further noted that examples of details of thehardware components of computing device 50 as shown in FIG. 9 anddescribed below.

As further shown in FIG. 2, the computing device 50 includes sharedmemory 310 (i.e., a memory buffer) that is accessible by both the usermode application (e.g., application 120B) and the kernel module 250.Preferably, the shared memory 310 can be a ring buffer, for example,which in its simplest form is a data structure that uses a single,fixed-size buffer as if it were connected end-to-end. A ring buffer isuseful as shared memory 310 as it does not need to have its elementsshuffled around when data is consumed, and, therefore, is well-suited asa FIFO (“first in, first out”) buffer. In this aspect, the user modeapplication 120B is configured to write data packets 314 to sharedmemory 310, and, in turn, kernel module 250 is configured to access andread these data packets (shown as data packets 316, but are the samedata packets). Moreover, once the ring buffer is full, a subsequentwrite by user mode application 120B will overwriting the oldest datapacket and so forth, which presumably has already been accessed bykernel module 250 and transmitted over the network 400 by NIC driver 240(and the underlying NIC hardware 260), as will be described in moredetail below.

According to the exemplary aspect, the disclosed system is capable ofachieving close to an ideal packet distribution (i.e., an average ofbelow 1 μs delta) with minimal outliers to this ideal distribution whileminimizing the processing usage of the computing device 50 compared toexisting approaches that require using the standard networking layer(e.g., network layers 220A to 220N) of the operating system of such adevice. Since the kernel module 250 works on top of the NIC driver 240,the kernel module 250 will work with any hardware including invirtualized environments. However, it should be appreciated that qualityof packet distribution in virtualized environments will depend on thescheduling performed by the hypervisor (i.e., the virtual machinemonitor), but will still be permissible within the context of thedisclosed system and method, assuming constant execution of the guestoperating system with constant CPU assignment of the host device.

It is further noted that while the exemplary aspect is described tofacilitate data packet transmission for user mode applicationsgenerating video streams sent over the network 400, the disclosed systemand method can be used for any type of application that requires datapackets to be sent at a precise time (as opposed to as soon aspossible). Moreover, it should be understood that the network 400 is anytype of applicable network for communicating data packets and dataoperations and can include a communication system (not shown) thatconnects the various devices by wire, cable, fiber optic, and/orwireless links facilitated by various types of well-known networkelements, such as hubs, switches, routers, and the like. It should beappreciated that the network 400 may employ various well-known protocolsto communicate information amongst the network resources. In one aspect,the network 400 can be part of the Internet as would be understood toone skilled in the art.

As shown in FIG. 2, the kernel module 250 is communicatively coupled touser mode application 120B (and any other applications utilized thedisclosed system) and also directly to shared memory 310. The kernelmodule 250 and user mode application 120B are configured to communicatecontrol signals 312 to each other. For example, each user modeapplication can ask the kernel module 250 if it is ready to transmitdata packets and the kernel module 250 can send a confirmation signalindicating its status in response to this request from the user modeapplication. As a result, the user mode application 120B can then beginplacing data packets 314 in shared memory 310, which the kernel module250 can then access as data packets 316 to ultimately be transmitted bythe NIC 260 to a consuming device over network 400. Moreover, the usermode applications (e.g., application 120B) can generate a control signalto the kernel module 250 to stop transmitting data packets 318immediately, for example.

Advantageously, by using the kernel module 250, the disclosed system isconfigured to send packets faster than conventional systems by avoid thestandard networking layers (e.g., network layers 220A to 220N) and alsoimprove packet scheduling by sending packets at the right time andminimizing bursts of data packets, as will be described below.

By providing the kernel module 250 above the NIC driver 240, whileavoiding the network layers 220A to 220N since it is directly coupled tothe shared memory 310 and bypasses network layers 220A to 220N, thecomputing device 50 can minimize the per-packet processing to achievehigher packet rate with less CPU usage of the computing device 50 whilemaintaining the ability to use any network interface controllersupported by the OS of the computing device 50. In particular, thekernel module 250 is running in kernel mode 200 and is part of thenetwork stack that allows sending data packets without the processing ofthe traditional network stack (e.g., network layers 220A to 220N) andusing the common interface exposed by the lowest level module that isresponsible for the NIC specific processing (i.e., the NIC driver 240).Advantageously, this process can be performed without interfering withthe other packets sent by the OS or other applications so that the sameNIC can also be used for other purposes.

Furthermore, by providing shared memory 310, the disclosed system canavoid the resource-intensive user mode to kernel mode transition (exceptwhen the application wants to reserve (or free) the shared memory datastructure) that conventional systems must continuously perform to senddata packets by allocating the shared memory structure that is accessedby both the user mode application (e.g., application 120B) and thekernel module 250. According to this aspect, access to this sharedmemory 310 can be synchronized using interlocked memory accessesfunctions offered by the OS and CPU of the computing device 250 so thatthe user mode application 120B can simply write data packets 314 to theshared memory 310, and, in parallel, the kernel module 250 can probe theshared memory 310 to access the data packets 316 to be sent by the NIC,as described above. Moreover, using the shared memory 310 to send thedata packets also has the advantage that the data packets are nevercopied or modified after being produced by the user mode application(e.g., application 120B). Thus, the application 120B can produce thedata packet in the shared memory 310 and this is the exact memory thatwill then ultimately be used by the NIC driver 240 to send the datapacket to the physical NIC 260 to be transmitted over network 400.

Moreover, according to the exemplary aspect, the kernel module 250 isconfigured to transmit data packets generated by user mode applicationswith a regular spacing so that they can be sent at the exact moment theyshould be sent (according to SMPTE standards and protocols, forexample). This precision cannot be achieved in the conventional usermode because of the non-real-time aspect of the operating system.However, configuring the sending thread of the kernel mode 200 of theexemplary system to run in the kernel mode 200 with the highest possiblepriority made available by the operating system allows the sendingthread to avoid getting preempted by other threads on the system.

FIG. 3A illustrates a block diagram of a system for timely and uniformdistribution real-time data packet transmission according to anotherexemplary aspect. As shown, the computing device 60 includes many of thesame components as computing device 50 described above, including kernelmodule 250. The description and functionality of these components willnot be repeated herein, but unless otherwise described, it should beassumed that the same components are configured to perform the samealgorithms and functions described above.

The primary distinction in this embodiment is that the sending threadexecuted by the kernel module 250 is designed to concurrently send mediastreams for a plurality of user mode applications, which are shown asapplications 120A and 120B. Importantly, a single sending thread (or apair of alternating threads as discussed below) is used to preservepacket ordering and precise timing. According to the exemplary aspect,the sending thread will be automatically started with the firstapplication (e.g., application 120A) using the Kernel module 250 andautomatically stopped when the last application (e.g., application 120B)stops using the kernel module 250.

Moreover, user mode application 120A is associated with andcommunicatively coupled to shared packet memory 310A, while user modeapplication 120B is associated with and communicatively coupled toshared packet memory 310B. Packet shared memories 310A and 310B(collectively referred to as “first shared memory buffers”) can be ringbuffers similar to shared memory 310 described above. In thisembodiment, user mode application 120A is configured to send a pluralityof data packets 314A to shared packet memory 310A and user modeapplication 120B is configured to send a plurality of data packets 314Bto shared packet memory 310B.

As further shown, each of user mode applications 120A and 120B iscoupled to shared schedule memory 320 (i.e., a second shared memorybuffer). According to the exemplary embodiments, each user modeapplications 120A and 120B will fill one or many packet groups for themedia stream, such that each packet group will be composed of aplurality of data packets (described above), with the specific numberdepending on the need of the application (e.g., the overall size of themedia stream, etc.). In addition, the kernel module 250 can assign eachdata packet group a unique identifier for that group, such that everydata packet can be uniquely identified by combining the packet groupidentifier generated by the kernel module 250 with the packet index intothat group to form a “packet identifier” for each packet. Because thekernel module 250 creates the packet group identifier, it can providefor faster and easier processing during execution of the sending thread.In general, a packet group is generated by the kernel module 250 (orcomponent thereof such as a packet group generator) and is composed oftwo parts. The first part is a big buffer subdivided into smallersections (i.e., a plurality of payload sections), with each section usedto store the data (e.g., the payload) of a separate packet. Each ofthose sections are identified by a packet index number. The second partis the ring buffer that is used by the kernel module 250 to communicateto the user mode application(s) when scheduled packets identifiers(i.e., the combination of group identifier and packet identifier) iscompletely sent, such that the ring buffer can be used again by the usermode application(s) to send some additional data packets.

The packet identifier enables the kernel module 250 to track and timelytransmit each data packet according to the specified schedule. Inparticular, according to the exemplary aspect, the shared schedulememory 320 can be a simple memory array to store multiple packetidentifiers generated and provided by each user mode application 120Aand 120B. Thus, each value in the array 320 (i.e., shared schedulememory 320) can represent a time slot in which a data packet can bescheduled (i.e., the array includes a listing of time slots andcorresponding packet identifiers from each of user mode applications120A and 120B). It is noted that the duration of each time slot can varydepending on the OS or the hardware, but the duration should be constantfor a given execution (i.e., during a transmission session by kernelmodule 250) as it directly affects the precision of packet scheduling.For example, in an exemplary aspect, the scheduled time slot can beequal to 1/performance counter frequency for the Windows operatingsystem, and, therefore, a packet identifier can be scheduled for eachsuch time slot, although slots may also be kept empty, indicating thereis no data packet to be sent at that particular time. In this aspect,the exemplary system can provide an efficient way to convert highprecision timestamps of the operating systems into those time slots.

Moreover, in an exemplary aspect, the shared schedule memory 320 can bea memory buffer that has a finite size, but mapping to an infiniteongoing schedule in that finite buffer is done through modulo arithmetic(i.e., the time slots “wrap around” upon reaching a certain value).Thus, the entry index in the schedule array 320 is the current timemodulo for the length of the array. However, even though moduloarithmetic is used for the schedule array 320, this memory design shouldnot cause any conflict for the time slots and packet identifiers as longthe schedule array is long enough (e.g., using a memory array having asize that enables up to one second of schedule).

Thus, according to the exemplary aspect, the kernel module 250 (as adata packet transmission scheduler) will continuously poll the sharedschedule memory 320 at the current system time to identify which packetidentifier is associated with the next time slot (according to thesystem time) to determine the order of transmitting packets. In otherwords, the kernel module 250 continuously polls the shared schedulememory 320 for each time slot and identifies the corresponding packetidentifier. Then, based on the packet identifier, the sending threadexecuted by the kernel module 250 will then read from either of sharedpacket memories 310A and 310B to access data packets 316A and 316B,respectively, based on which packet was scheduled as indicated in theshared schedule memory 320. In turn, the kernel module 250 can identifythese data packets 316A and 316B based on their packet identifiers andthen a data packet transmission controller as a sub-component of thekernel module 250 can pass them according to the scheduled time slot toNIC 260 to be transmitted as data streams (i.e., shown as data streams318A and 318B) to network 400 and ultimately to the targeted one or moremedia consuming devices, for example.

It should be appreciated that the same timing scheme can be implementedwith respect to the exemplary embodiment described above with respect toFIG. 2. That is, although not shown, control signals 312 can includetime slot and corresponding packet identifiers for data packets 314 andorder to coordinate the transmission thread (i.e., data stream 318).

As further shown, the kernel module 250 is shown to be communicativelycoupled to user mode applications 120A and 120B. As a result, respectivecontrol signals 312A and 312B can be communicated between the devices asshown. For example, in response to a request from a user modeapplication 120A and 120B, the kernel module 250 can transmit a signalto each such applications indicating it is in a ready to transmit statusand that it is polling shared schedule memory 320 for schedule data.Moreover, each user mode applications 120A and 120B can transmit controlsignals to kernel module 250 informing the kernel module 250 that thereis no more data to be transmitted for that application. As a results,the sending thread (or either thread) can be stopped after the lastapplications stops using it.

According to the exemplary embodiment of FIG. 3A, by providing a singlememory for the shared schedule memory for both user mode applications,the computing device 60 provides maximum performance since the kernelmodule 250 will only need to poll a single location to identify whichpackets to send and their corresponding time slots. However, in certaininstances, using a single array for the shared schedule memory may leadto issues of security and fault tolerance as each user mode applicationwill have access to the same shared schedule (i.e., shared schedulememory 320), and, therefore, a single misbehaved application couldun-schedule (or de-prioritize) packets scheduled by another application.

FIG. 3B illustrates a block diagram of a system for timely and uniformdistribution real-time data packet transmission according to yet anotherexemplary aspect. As shown, computing device 70 includes many of thesame components as described above with respect to computing device 60,and such components will not be described again. The main differencebetween the two embodiments is that instead of a single shared schedulememory 320, the computing device 70 provides a separate shared schedulememory 320A for application 120A and also shared schedule memory 320Bfor application 120B (collectively referred to as second shared memorybuffers). As a result, each user mode application 120A and 120B can haveits own schedule, which improves the security of the system as it isseparately polled by the kernel module 250 and other user modeapplications do not have access (and cannot maliciously de-prioritizethe schedule, or the like). The tradeoff in this case is that separateshared schedule memories 320A and 320B must be separately accessed bythe kernel module 250, which, in turn, requires additional processing tomerge the different schedules together by the kernel module 250, aswould be appreciated to one skilled in the art.

For either embodiment of computing device 60 (single schedule memoryarray) or computing device 70 (multiple schedule memory arrays), thesending thread of the kernel module 250 is configured to wait to sendpackets until at the right time (i.e., the scheduled time slotassociated with the corresponding packet identifier). As will bedescribed in detail below, this waiting period can be performed througha busy loop, since the sending device cannot rely solely only on thesleeping function of the operating system of the device since thedisclosed methods can be applied non real-time operating systems.

Thus, according to a refinement of the exemplary embodiments describedabove, in one aspect, the kernel module 250 is configured to executemultiple threads concurrently by switching back and forth betweenthreads. In particular, certain operating systems implement time limitson high priority threads so that they cannot run constantly/continuouslywithout causing other operational issues. Thus, the kernel module 250can be configured to use two or more threads running in alternation tocircumvent this operational limit.

FIG. 4 illustrates a timing of the kernel module for executing multiplethreads for timely and uniform distribution real-time data packettransmission according to yet another exemplary aspect. As shown, a pairof threads A and B are shown that alternate between a sending state anda sleeping state. In other words the kernel module 250 operates as twothreads where thread A sends data packets while thread B sleeps and thenthe threads alternate, such that thread A sleeps while and thread Bsends packets, and so forth. It should be appreciated that kernel module250 can use the alternating threads A and B to send data for a singleuser mode application (e.g., application 120B as shown in FIG. 2) or tosend data for a plurality of user mode applications (e.g., applications120A and 120B as shown in FIGS. 3A and 3B) while ensuring precise andtimely transmission.

Importantly, each of threads A and B should run on its own processingcore (although there can be two logical core of the same physical core),where both of the processing cores are reserved for the threads so thatother system thread do not use them. Moreover, each thread should onlystop the sending state and transition to the sleep state when thatthread is sure that the other thread has woken up (i.e., entered thesending state), since non real-time operating system do not guaranteewhen a thread wakes up. Finally, each thread that enters a sending statemust also be sure that the other thread is about to enter the sleepingstate to avoid a case where both threads are sending packets at the sametime. Exemplary algorithms for performing this switching betweenmultiple threads will be described in more detail below. By usingmultiple threads, the kernel module 250 can effectively provide twoprocessing cores that are used (i.e., in the sending state) +/−50% ofthe time and are in the idle sleeping state 50% of the time. Moreover,by running multiple threads, the kernel module 250 can circumvent anylimits instituted by the operating system that prevent such a threadfrom constant/continuous execution by the CPU.

In general, it should be appreciated that setting the priority of thesending thread to the highest possible priority should be enough so thatthe kernel module does not get preempted (i.e., interrupted to executeanother thread). However, since the kernel module 250 uses the twosending threads A and B that work one after the other, it is possiblethat the OS can schedule some other thread to run on the CPU core thatwas running the currently sleeping thread. Although this will likely notcause significant problems, because the two cores running the twosending thread might be two logical cores of the same physical core ordue to CPU memory caching or some other low level hardware reason, it ispossible that having other threads running during the sleeping period ofthe core used by sending thread can affect quality and performance ofscheduling. Thus, as described above, in the exemplary embodiment, thekernel module 250 is preferably designed to monitor all the otherthreads running on the operating system and modify their affinity sothat the other threads are never scheduled on the same processing coreas the processing core dedicated for running the sending threads.Moreover, the Interrupt Service Routine (ISR) on the processing coredesigned for the sending threads are preferably reduced as much aspossible as the ISR can also interrupt the sending thread. However, thisis not as critical as the preventing interrupts of the other threadssince ISRs have to be short (e.g., a few μs at most).

FIG. 5 illustrates a flowchart for a method for timely and uniformdistribution real-time data packet transmission according to anexemplary aspect. In general, it is noted that the methods as describedas follows refer to the components of the exemplary systems above. Asshown, initially at step 505, one or more user mode applications islaunched and begins generating data packets. The user mode applicationsmay also send a request to the kernel module 250 to confirm that it isready to execute the sending thread. Next, at step 510, the kernelmodule 250 operating in kernel mode 200 can create a packet group asdescribed above. At this point, a control signal may be generated bykernel module 250 indicating to the user mode applications it is in aready to transmit state. The algorithm then performs the kernelmode/user mode switch where the user mode application(s) beginspreparing the data packets for transmission. Thus, as generally show,all steps performed in FIG. 5, except steps 510 and 550 are performed inuser mode. Steps 510 and 550 are performed in kernel mode by the kernelmodule 250 that creates and deletes the packet group, respectively.Otherwise, the operating system transitions back to user mode where theuser mode application performs the processing shown therein.

Specifically, at step 515, the user mode application performs invariantwork on the data packets to prepare them for network transmission. Forexample, when all the packets are to be sent to the same destination,all Ethernet, IP and UDP headers can all be computed once by theapplication so that only the payload need to be updated as part of the“main loop”. For example, generating the Ethernet header will requirethat the application convert the destination IP to a destination mediumaccess control (“MAC”) address, which can be a simple function for amulticast destination, for example, or it might require a network lookupusing address resolution protocol (“ARP”) in the case of a unicastdestination on the same subnet.

Next, at step 520, the user mode application(s) will check the ringbuffer (i.e., shared memory 310) to determine whether the ring buffer isempty. If it is empty, the user mode application will proceed to step525 where it will wait a predetermined time period before checking thering buffer again. For example, the time period may depend on theapplication need related to packet rate. Since sleep of the operatingsystem is coarse compared to the speed at which the kernel module 250can send data packets, the predetermined time period can simply be tosleep for the minimum amount of time possible by the OS in one example(e.g., 1 ms for Windows OS). In any event, as further shown, the methodthen proceeds to step 545 where the user mode application confirmswhether to stop transmission of data packets. For example, duringexecution of the sending thread(s) of the kernel module 250, the usermode application(s) may determine that it is finished and has no moredata packets to send. In this case, the user mode application cantransmit a control signal back to the kernel module 250 to stopexecution of the sending thread. If so, the user mode/kernel mode switchwill be performed where the kernel mode 250 will then delete the packetgroup from the shared memory 310 before the application is stopped atstep 555.

Assuming that the user mode application does not stop transmission atstep 545, the method returns to step 520 where the user modeapplication(s) again checks the ring buffer to determine whether it isempty or contains a packet group. This loops is continued until theapplication determines that the ring buffer is not empty. For example,the ring buffer will be empty if the steps of preparing packets (i.e.,steps 530 to 540, discussed below) are performed faster than the speedat which the packets are sent (and so the application can easilythrottle its work based on the sending speed). In any event, the packetswill be added back to the ring buffer at step 650 (discussed below) assoon as they are sent so that the user mode application knows the packetwas sent and it can use the ring buffer to send additional packets. Asfurther shown, when the ring buffer is not empty, the method proceeds tostep 530 where the application gets a free data packet from the ringbuffer (i.e., the shared memory 310), fills the packet (e.g., with thepayload) at step 535 and schedules the packet for transmission at step540 (and ultimately transmitted by NIC 260). The scheduling of each datapacket will be described in more detail below with respect to FIGS. 7Aand 7B. The filling of data packets, includes, adding the payload (andpossibly completing or adjusting the headers for some part not performedas part of the invariant work), and will depend on what the applicationis transmitting and the protocols it is using. The method then returnsto step 545 and then loop continues. As is shown, the user modeapplication continues to get free packets and schedule data packets fortransmission until a stop transmission signal is detected at step 545.Advantageously, the disclosed algorithm minimizes the number oftransitions between user mode and kernel mode, such that aside thecreating of the packet group and the deleting of the packet groupperformed by the kernel module 250, the user mode application performsall other processing steps shown in FIG. 5 for the filling andscheduling of data packet transmission.

FIG. 6 illustrates a flowchart for execution of the sending thread ofthe kernel module according to an exemplary aspect. As shown, the kernelthread (i.e., the sending thread executed by kernel module 250) islaunched at step 605. For example, according to the exemplary aspect,the kernel thread is created when the first application (e.g., user modeapplication 120A or 120B) start using the kernel module. The sendingthread will continue to run by polling the schedule as long as there isan application running and transmitting data packets. As will bedescribed below, step 620 will return a false (i.e., a “no”) when thereare no more applications using the kernel module for packettransmission. Next, at step 610, a system value for “last check time”(which can be a variable shared between the kernel mode 200 and usermode 100 and is a read only variable in the user mode 100) is set as thecurrent time “now” (e.g., according to the system clock of the computingdevice). At step 615, the two or more threads (e.g., threads A and B)are synchronize as described above, that is, one thread is set to asending state while the other thread is set to a sleeping state. Thetransition of these alternating states will be described in detailbelow.

Next, at step 620, the kernel module 250 checks to see if it shouldcontinue execution of the sending threads. In the exemplary aspect, step620 will always return a “true” (i.e., a “yes”) as long as at least oneuser mode application is using the kernel module 250 for packettransmission. Alternatively, in one aspect, the one or more user modeapplication(s) may in the interim transmit a control signal indicatingthat data packet transmission should be stopped. If the sending shouldbe stopped (i.e., no more applications are transmitting data packets),the method will proceed to step 625 where the sending thread isterminated. Otherwise, the method will proceed to step 630 where a valuefor the “next time” is set as an increment of the “last time check”value plus one. The sending thread executed by the kernel module 250will then check at step 635 whether the next time is greater than thecurrent time. If so, the method proceeds to step 640 to determinewhether there is a packet ID in a packet list (discussed below withrespect to step 665) to be sent to the NIC driver 240 for scheduledtransmission as a transmission control signal by the kernel module 205.If not, the method will proceed back to step 615. Otherwise, at step645, the kernel module 250 will package the packets added to the list atstep 665 and send them to the NIC driver 240 by pulling the data packetfrom the shared packet memory (e.g., ring buffer 310). The packet isthen returned to the ring buffer after transmission at step 650 (so thatthe user mode application can fill it with new data and schedule itagain in the future) and then the method returns to step 615 to continuethe sending thread.

Alternatively, if, at step 635, the value for the “next time” was notgreater than the current time value, then it is determined that thepacket ID in schedule slot “next time” has to be sent. In theseinstances, the method proceeds to step 655 where the kernel module 655sets the value for the “last check time” as the value for the “nexttime”. At step 660, the kernel module 250 will identify the packet ID atthe scheduled slot in the shared schedule memory (e.g., shared packetmemory 320) where it will clear the schedule slot for the slot thatcorresponds to the “last check time”. It is noted that at step 660, aninterlocked function can be implemented to synchronize access to thevariable (i.e., the value of the “last time check”) that is shared bythe multiple threads. Finally, at step 665, the packet identifier canthen be added to the packet list. In other words, the packet ID(s) areadded to the packet list that is sent by the NIC driver 240 at step 645.By accumulating packets in this list (as opposed to sending them one atthe time as they are discovered), the kernel module 250 is effectivelyable to catch up when it discovers a packet may be late. As described inabove, the kernel module 250 can operate more efficiently by sendingmultiple packets in one call to the NIC driver 240 at step 645 asopposed to multiple calls (one packet at the time) to the NIC driver240. However, this will result in packets be sent in a burst, which issomething the disclosed system is attempting to limit or avoid. Thus,preferably, the packet list sent to the NIC driver 240 will contain asingle packet and it will only contain multiple packets when the packetsare late on schedule. Finally, as shown, after the packet ID(s) is addedto the list, the method returns to step 620 until the “next time” valueis caught up with the current time so that packets in the list are sent(at step 645) or the sending thread is ultimately terminated at step625, as discussed above.

As described above, the disclosed system and method are provided to runon a non-real-time operating system and since the NIC 260 and/or the NICdriver 240 may not be designed to be operated in real-time. Moreover, itis entirely possible that data packets are, for various reasons, nolonger to be sent or the sending thread may be interrupted for someexceptional reason by the OS. According to the exemplary embodiments,the sending thread executed by the kernel module 250 can, in thesecases, be designed to catch up on any potential backlog as quickly aspossible. In general, most operating systems require that the NIC driverallows on being called with multiple data packets (instead of a singledata packet) to reduce the calling overhead, and, since data packets arelate anyway, the kernel module 250 can be configured to use thatmechanism to send them back to back in a small burst in an effort toavoid unsent data and accumulating that lateness for the future.However, it should be appreciated that this small burst sending methodwill only be used by the kernel module 250 in exceptional cases whereunexpected events happens or if the system is being pushed to the limit.In an alternative aspect, the kernel module 250 may conclude that thespecific data packet was too late and will not schedule the packet fortransmission and move on to the next data packets, but this will be atradeoff between all packets being sent and schedule accuracy that canbe determined by the specific system designer, for example.

FIGS. 7A and 7B illustrate a flowchart for a method for scheduling datapackets for timely and uniform transmission according to an exemplaryaspect. In general, the algorithm shown can correspond to the schedulingof packets generally noted above with respect to step 540 of FIG. 5. Asshown, initially at step 705, packet IDs will be added by the user modeapplication(s) to the shared schedule memory 320. As described above,each data packet has a unique packet identifier (“ID”) that can begenerated by combining the packet group identifier with the packet indexwithin that group. At step 710, the user mode application (e.g.,application 120A or 120B) confirms whether the packet time associatedwith the packet identifier (accessed from the shared schedule memory320) is greater than the last time check. If it's not, then the usermode application knows that the corresponding data packet is too late(step 715) at which point the packet is either discarded or the systemtries to schedule the packet again at some later time depending on theneeds of data it is sending.

Otherwise, the method will proceed to step 720 where the user modeapplication will check whether the scheduled packet time is greater thanthe value of the “last time check” plus the schedule duration (i.e., thelength of the time slot). If so, then the user mode application willknow that the data packet is scheduled for too far in the future andwill proceed to step 725 where it will wait a small predetermined periodof time before returning to step 710. Otherwise, the user modeapplication will proceed to step 730 to determine whether the scheduledtime slot (i.e., in shared schedule memory array 320) is empty or has apacket identifier. If it is not empty, the method proceeds to step 735,increments the packet time by 1 (i.e., the time duration of one timeslot) and returns to step 710 to begin the scheduling process again.

However, if at step 730, the user mode application determines that theschedule slot in the shared schedule memory 320 is empty, the user modeapplication will proceed to step 740 where the packet identifier for theparticular data packet is stored in the free schedule time slot (whichcan subsequently be polled by the kernel module 250) as described above.The user mode application will then confirm at step 745 that the packettime for the data packet is still greater than the value of the “lasttime check”. If it is, then the packet is confirmed to be scheduled inthe shared schedule memory 320 at step 750, which was performed byadding the packet ID for the particular data packet in the correspondingtime slot at step 740. Otherwise, the method will proceed to step 755 todetermine if the current schedule slot still has a packet identifier(meaning it has not been sent quite yet). If not, then the user modeapplication knows that the data packet it scheduled was not too late andconfirms (i.e., a return value) that the data packet was scheduled ontime at step 750. Otherwise, if the current schedule time slot still hasa packet identifier at step 755, then the method proceeds to step 760and clears the schedule slot as the packet it is attempting to schedulehas been determined to be too late at step 765, in which case point thepacket is either discarded or try schedule the packet again at somelater time depending on the needs of data it is sending. It is notedthat the process shown in FIGS. 7A and 7B can be continually performedcontinuously for the scheduling of data packets as the user modeapplication is generating a media stream to be transmitted using thesending thread of the kernel module 250 and the exemplary systems andalgorithms described above.

It is noted that according to an exemplary aspect, the combined steps ofread and write of packet identifiers need to be interlocked, i.e., thecombination of steps 730 and 740 and the combination of steps 755 and760 should be interlocked. In general, interlocked operations arelightweight CPU mechanisms that guarantee that only one application canperform a group of read and write at a given place in memory. In theexemplary embodiment, only the user mode application (or only one of theuser mode applications if there is multiple) or the kernel module willbe able to read and write that precise memory slot in the schedule.

FIG. 8 illustrates a flowchart for a method for synchronizing aplurality of threads to perform shared timely and uniform distributionreal-time data packet transmission according to an exemplary aspect. Forexample, the exemplary method can be performed by kernel module 250executing a pair of threads, such as threads A and B as shown in FIG. 4and described above. Moreover, it is noted that the algorithm shown inFIG. 8 can be executed for each thread running and indicates when itshould transition from the sleep state to the sending state and viceversa.

As shown, initially, at step 805, the kernel module 250 begins theprocess of synchronizing the two threads (e.g., threads A and B), forexample, by polling the shared schedule memory 320 for the packetidentifiers and accessing the shared packet memories 310A and 310B forrespective data packet 316A and 316B. Next, at step 810, a first thread(e.g., thread A) will check to determine whether a pause has beenrequested (e.g., generated by the other thread B). If not, then thread Awill assume it's the only thread running at step 815 can continuetransmitting data packets. Otherwise, if a pause has been requested bythe other thread, the method will proceed to step 820 where the runningthread will temporarily set the value “pause requested” to false. In theexemplary aspect, steps 810 and 820 will be interlocked.

Furthermore, at step 825, the number of threads will be incremented by 1at step 825 and then the method will wait for a small time period atstep 830, before the value of the “pause requested” variable, which isshared for both threads, will be set to “true”. It is noted that becausethe “pause requested” variable is shared between threads, theincrementing step 825, and also the decrementing step 850 (discussedbelow), will need to be an interlocked/atomic operation. After the“pause requested” variable is set to “true”, the thread A will be in thesleeping state and will generate a request for thread (e.g., thread Bwhich is currently transmitted packets) to enter the pause state. Then,the thread A will enter a continuous loop at step 840 where a value for“continue wait” will be set to the value of “pause requested”, which asnoted above is set to true, and confirm that the number of pausedthreads is less than or equal to 1 (i.e., if the number is greater than1 then the kernel module 250 will know that both threads are in thepaused/sleeping state and that the threads are not correctly alternatingbetween the two states).

At step 845, the paused thread A will confirm that it should continue towait (i.e., remain in sleep state) and return to step 840, at whichpoint this loop will continue until the thread B enters the pause state.Once the thread A is no longer in the wait state at step 845 (e.g., byreceiving a signal from thread B that it has entered the pause state),the method proceeds to step 850 where thread A enters the sending stateand the number of paused threads is decreased by 1. Thread A thenassumes it's the only thread running at step 815 and continues thesending process until another pause is requested at step 810.Accordingly, each sending thread in the system (e.g., sending threads Aand B executed by the kernel module 250) can perform the algorithmdisclosed in FIG. 8 and continue to switch between the sleeping stateand the sending state as shown in FIG. 4.

FIG. 9 illustrates a high-level block diagram of a system for timely anduniform distribution real-time data packet transmission according to anexemplary aspect. As shown, the system 900 includes various hardwarecomponents and other features, for use in accordance with aspectspresented herein. Aspects presented herein may be implemented usinghardware, software, or a combination thereof and may be implemented inone or more computer systems or other processing systems. Thus,according to an exemplary embodiment, system 900 may also include one ormore processors, such as processor 902, that is connected to acommunication interface 906 (e.g., a communications bus, cross-over bar,or network). Moreover, the communication interface is connected to thenetwork interface controller 260 controlled by the NIC driver 240, whichis configured to transmitted data packets to media consuming devices vianetwork 400, as described above.

Moreover, by way of example, an element, or any portion of an element,or any combination of elements may be implemented with a “processingsystem” that includes one or more processors. The processing systemfurther includes one or more modules (including kernel module 250) forexecuting the algorithms described herein. The modules may be softwaremodules running in the processor 902, resident/stored in memory 908,e.g., a computer readable medium, one or more hardware modules coupledto the processor 902, or some combination thereof. Examples ofprocessors include microprocessors, microcontrollers, digital signalprocessors (DSPs), field programmable gate arrays (FPGAs), programmablelogic devices (PLDs), state machines, gated logic, discrete hardwarecircuits, and other suitable hardware configured to perform the variousfunctionality described throughout this disclosure. One or moreprocessors in the processing system may execute software. Software shallbe construed broadly to mean instructions, instruction sets, code, codesegments, program code, programs, subprograms, software modules,applications, software applications, software packages, routines,subroutines, objects, executables, threads of execution, procedures,functions, etc., whether referred to as software, firmware, middleware,microcode, hardware description language, or otherwise.

Computer system 900 also includes a main memory 904, preferably randomaccess memory (RAM), and may also include a secondary memory 908. Thesecondary memory 908 may include, for example, a hard disk drive 910and/or a removable storage drive 912, representing a floppy disk drive,a magnetic tape drive, an optical disk drive, etc. The removable storagedrive 912 reads from and/or writes to a removable storage unit 916 in awell-known manner. Removable storage unit 916, represents a floppy disk,magnetic tape, optical disk, etc., which is read by and written toremovable storage drive 912. As will be appreciated, the removablestorage unit 916 includes a computer usable storage medium having storedtherein computer software and/or data.

In alternative implementations, secondary memory 908 may include othersimilar devices for allowing computer programs or other instructions tobe loaded into computer system 900. Examples of such may include aprogram cartridge and cartridge interface (such as that found in videogame devices), a removable memory chip (such as an erasable programmableread only memory (EPROM), or programmable read only memory (PROM)) andassociated socket, which allow software and data to be transferred fromthe removable storage unit 908 to computer system 900. By way ofexample, and not limitation, such computer-readable media can compriseRAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic diskstorage or other magnetic storage devices, or any other medium that canbe used to carry or store desired program code in the form ofinstructions or data structures and that can be accessed by a computer.Disk and disc, as used herein, includes compact disc (CD), laser disc,optical disc, digital versatile disc (DVD), and floppy disk where disksusually reproduce data magnetically, while discs reproduce dataoptically with lasers. Combinations of the above should also be includedwithin the scope of computer-readable media.

Computer programs (also referred to as computer control logic) arestored in main memory 904 and/or secondary memory 908. Such computerprograms, when executed, enable the computer system 900 to perform thefeatures and algorithms of the exemplary aspects discussed herein. Inparticular, the computer programs, when executed, enable the processor902 to perform the features of the presented herein. Accordingly, suchcomputer programs represent controllers of the computer system 900.

If implemented in software, the functions may be stored on or encoded asone or more instructions or code on a computer-readable medium.Computer-readable media includes computer storage media. Thus, whenaspects are the implemented using software, the software may be storedin a computer program product and loaded into computer system 900 usingremovable storage drive 912, or hard drive 910, for example. The controllogic (software), when executed by the processor 902, causes theprocessor 902 to perform the functions as described herein. In anotherexample implementation, aspects may be implemented primarily in hardwareusing, for example, hardware components, such as application specificintegrated circuits (ASICs). Implementation of the hardware statemachine so as to perform the functions described herein will be apparentto persons skilled in the relevant art(s).

Aspects may also be implemented using a combination of both hardware andsoftware. Accordingly, in one or more example aspects, the functionsdescribed may be implemented in hardware, software, firmware, or anycombination thereof.

While aspects have been described in conjunction with the exampleimplementations outlined above, various alternatives, modifications,variations, improvements, and/or substantial equivalents, whether knownor that are or may be presently unforeseen, may become apparent to thosehaving at least ordinary skill in the art. Accordingly, the exampleimplementations of the invention, as set forth above, are intended to beillustrative, not limiting. Various changes may be made withoutdeparting from the spirit and scope of the aspects. Therefore, theaspects are intended to embrace all known or later-developedalternatives, modifications, variations, improvements, and/orsubstantial equivalents.

Thus, the claims are not intended to be limited to the aspects shownherein, but is to be accorded the full scope consistent with thelanguage claims, wherein reference to an element in the singular is notintended to mean “one and only one” unless specifically so stated, butrather “one or more.” Unless specifically stated otherwise, the term“some” refers to one or more. All structural and functional equivalentsto the elements of the various aspects described throughout thisdisclosure that are known or later come to be known to those of ordinaryskill in the art are expressly incorporated herein by reference and areintended to be encompassed by the claims. Moreover, nothing disclosedherein is intended to be dedicated to the public regardless of whethersuch disclosure is explicitly recited in the claims. No claim element isto be construed as a means plus function unless the element is expresslyrecited using the phrase “means for.”

What is claimed:
 1. A system for data packet transmission by a computingdevice, the system comprising: a data packet memory buffer configured tostore a plurality of data packets respectively generated by a pluralityof software applications operating in a user mode of an operating systemof the computing device; a time slot memory buffer configured to store aplurality of time slots for scheduling a timing of the data packettransmission of the plurality of data packets; a kernel module operatingin a kernel mode of the operating system of the computing device andconfigured to execute a plurality of alternating threads fortransmitting the plurality of data packets for each of the plurality ofsoftware applications; wherein each of the plurality of softwareapplications is coupled to the data packet memory buffer that stores theplurality of data packets for the plurality of software applications;wherein the kernel module is further configured to poll the time slotmemory buffer to access a plurality of packet identifiers associatedwith the plurality of data packets generated by the plurality ofsoftware applications; wherein the plurality of packet identifiers areassociated with the plurality of time slots for the data packettransmission, respectively; wherein the kernel module is furtherconfigured to access each of the plurality of data packets from the datapacket memory buffer based on the respective packet identifier andcorresponding time slot; wherein each of the plurality of alternatingthreads is configured to transition from a sending state to a sleepingstate upon determining that the other thread of the plurality ofalternating threads has transitioned from the sleeping state to thesending state, such that the kernel module is configured to circumventat least one operational limit required by the operating system of thecomputing device to prevent continuous thread execution by a processorof the computing device; wherein the kernel module is configured todirectly access the plurality of data packets from the data packetmemory buffer by bypassing a transition through a network stack in thekernel mode of the operating system before network transmission; andwherein each of the data packet memory buffer and the time slot memorybuffer are shared between the user mode and the kernel mode of theoperating system of the computing device.
 2. The system according toclaim 1, wherein the data packet memory buffer comprises a first datapacket memory buffer configured to store respective data packets of afirst software application of the plurality of applications and a seconddata packet memory buffer configured to store respective data packets ofa second software application of the plurality of applications, andwherein time slot memory buffer comprises a first time slot memorybuffer configured to store respective time slots for scheduling thetiming of the data packet transmission of the first software applicationand a second time slot memory buffer configured to store respective timeslots for scheduling the timing of the data packet transmission of thesecond first software application.
 3. The system according to claim 1,wherein the kernel module comprises: a packet group generator configuredto generate a packet group for the data packet memory buffer; and a datapacket transmission scheduler configured to poll the time slot memorybuffer to access the plurality of packet identifiers associated with theplurality of data packets generated by the plurality of softwareapplications.
 4. The system according to claim 3, wherein the kernelmodule further comprises a data packet transmission controller coupledto a driver of a network interface controller and configured to controlthe driver to transmit each of the plurality of data packets via thenetwork interface controller over the network based on the correspondingtime slot.
 5. The system according to claim 4, wherein the kernel moduleis further configured to send a packet list to the driver of the networkinterface controller that includes two or more data packets of theplurality of data packets when the kernel module determines that atleast one data packet of the two more data packets included in thepacket list is late on schedule according to the corresponding time slotin the time memory buffer.
 6. A system for data packet transmission by acomputing device, the system comprising: a data packet memory bufferconfigured to store a plurality of data packets respectively generatedby a pair of software applications operating in a user mode of anoperating system of the computing device; a time slot memory bufferconfigured to store a plurality of time slots for scheduling a timing ofthe data packet transmission of the plurality of data packets; a kernelmodule operating in a kernel mode of the operating system of thecomputing device and configured to execute a pair of alternating threadsfor transmitting the plurality of data packets for each of the pair ofsoftware applications, respectively; wherein each of the pair ofsoftware applications is coupled to the data packet memory buffer thatstores the plurality of data packets for the pair of softwareapplications; wherein the kernel module is further configured to accesseach of the plurality of data packets from the data packet memory bufferbased on a respective packet identifier for each data packet; whereineach of the pair of alternating threads is configured to transition froma sending state to a sleeping state upon determining that the otherthread of the pair of alternating threads has transitioned from thesleeping state to the sending state, such that the kernel module isconfigured to circumvent at least one operational limit required by theoperating system of the computing device to prevent continuous threadexecution by a processor of the computing device; and wherein the kernelmodule is configured to directly access the plurality of data packetsfrom the data packet memory buffer by bypassing a transition through anetwork stack in the kernel mode of the operating system before networktransmission.
 7. The system according to claim 6, wherein each of thedata packet memory buffer and the time slot memory buffer are sharedbetween the user mode and the kernel mode of the operating system of thecomputing device.
 8. The system according to claim 6, wherein the kernelmodule is further configured to poll the time slot memory buffer toaccess the plurality of packet identifiers associated with the pluralityof data packets generated by the pair of software applications, with theplurality of packet identifiers being associated with the plurality oftime slots for the data packet transmission, respectively.
 9. The systemaccording to claim 6, wherein the data packet memory buffer comprises afirst data packet memory buffer configured to store respective datapackets of a first software application of the pair of applications anda second data packet memory buffer configured to store respective datapackets of a second software application of the pair of applications,and wherein time slot memory buffer comprises a first time slot memorybuffer configured to store respective time slots for scheduling thetiming of the data packet transmission of the first software applicationand a second time slot memory buffer configured to store respective timeslots for scheduling the timing of the data packet transmission of thesecond first software application.
 10. The system according to claim 6,wherein the kernel module comprises: a packet group generator configuredto generate a packet group for the data packet memory buffer; and a datapacket transmission scheduler configured to poll the time slot memorybuffer to access the plurality of packet identifiers associated with theplurality of data packets generated by the pair of softwareapplications.
 11. The system according to claim 10, wherein the kernelmodule further comprises a data packet transmission controller coupledto a driver of a network interface controller and configured to controlthe driver to transmit each of the plurality of data packets via thenetwork interface controller over the network based on the correspondingtime slot of the plurality of time slots.
 12. The system according toclaim 11, wherein the kernel module is further configured to send apacket list to the driver of the network interface controller thatincludes two or more data packets of the plurality of data packets whenthe kernel module determines that at least one data packet of the twomore data packets included in the packet list is late on scheduleaccording to the corresponding time slot in the time memory buffer. 13.A system for data packet transmission by a computing device, the systemcomprising: a data packet memory buffer configured to store a pluralityof data packets generated by a pair of software applications,respectively, operating in a user mode of an operating system of thecomputing device; a kernel module operating in a kernel mode of theoperating system of the computing device and configured to execute apair of alternating threads for transmitting the plurality of datapackets for each of the pair of software applications, respectively;wherein each of the pair of alternating threads is configured totransition from a sending state to a sleeping state upon determiningthat the other thread of the pair of alternating threads hastransitioned from the sleeping state to the sending state, such that thekernel module is configured to circumvent at least one operational limitrequired by the operating system of the computing device to preventcontinuous thread execution by a processor of the computing device. 14.The system according to claim 13, wherein the kernel module isconfigured to directly access the plurality of data packets from thedata packet memory buffer by bypassing a transition through a networkstack in the kernel mode of the operating system before networktransmission.
 15. The system according to claim 14, further comprising:a time slot memory buffer configured to store a plurality of time slotsfor scheduling a timing of the data packet transmission of the pluralityof data packets; and wherein the kernel module is further configured topoll the time slot memory buffer to access a plurality of packetidentifiers associated with the plurality of data packets generated bythe pair of software applications, with the plurality of packetidentifiers being associated with the plurality of time slots for thedata packet transmission, respectively.
 16. The system according toclaim 15, wherein the kernel module comprises: a packet group generatorconfigured to generate a packet group for the data packet memory buffer;and a data packet transmission scheduler configured to poll the timeslot memory buffer to access the plurality of packet identifiersassociated with the plurality of data packets generated by the pair ofsoftware applications.
 17. The system according to claim 15, wherein thedata packet memory buffer comprises a first data packet memory bufferconfigured to store respective data packets of a first softwareapplication of the pair of applications and a second data packet memorybuffer configured to store respective data packets of a second softwareapplication of the pair of applications, and wherein time slot memorybuffer comprises a first time slot memory buffer configured to storerespective time slots for scheduling the timing of the data packettransmission of the first software application and a second time slotmemory buffer configured to store respective time slots for schedulingthe timing of the data packet transmission of the second first softwareapplication.
 18. The system according to claim 15, wherein the kernelmodule further comprises a data packet transmission controller coupledto a driver of a network interface controller and configured to controlthe driver to transmit each of the plurality of data packets via thenetwork interface controller over the network based on the correspondingtime slot of the plurality of time slots.
 19. The system according toclaim 18, wherein the kernel module is further configured to send apacket list to the driver of the network interface controller thatincludes two or more data packets of the plurality of data packets whenthe kernel module determines that at least one data packet of the twomore data packets included in the packet list is late on scheduleaccording to the corresponding time slot in the time memory buffer. 20.The system according to claim 13, wherein each of the data packet memorybuffer and the time slot memory buffer are shared between the user modeand the kernel mode of the operating system of the computing device.